HealthFormer: Dual-level time-aware Transformers for irregular electronic health record events
The paper proposes HealthFormer, a dual-level, time-aware Transformer framework pretrained on large-scale longitudinal EHRs using multi-task self-supervision to learn hierarchical, event-centric patient representations that achieve state-of-the-art performance in incident cancer prediction through straightforward fine-tuning.